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ABSTRACT 


The previously developed guidance law implemented onboard the Small Unmanned 
Aerial Vehicle (SUAV) relies exclusively on the information from the image processing 
software and allows the performance of coordinated SUAV guidance and vision-based target 
tracking and motion estimation. This enables “passive only” coordinated tracking of non- 
cooperative targets. An analysis of the system performance shows that the developed target 
tracking law demonstrates poor range holding capability when the target performs evasive 
maneuvers. Therefore, a new guidance law has been formulated by resolving SUAV 
dynamics with respect to the moving target frame, as opposed to the inertial frame in 
previous formulation. This simple modification results in theoretically achievable perfect 
range holding capability for the price of requiring the target motion information to be known. 
As aresult, this new modification is based on the assumption of known target states, which in 
turn requires an implementation of a target motion estimator. An obvious tradeoff in 
performance of the “passive only” and “estimator based” target tracking systems is 


investigated in this thesis under realistic conditions including target loss events. 


This work extends previous results by investigating the performance of both guidance 
laws to the variation in target velocity and frequency of tracking loss events. The results 
obtained are based on the high fidelity 6DOF simulation implemented in SIMULINK, and 
analyzed using the multi-criteria optimization methodology introduced in the previous work. 
The results show that both guidance laws suffer predictable degradation in performance when 
subject to the external disturbances and tracking loss events. However, in the absence of 
tracking loss events, the new guidance law suffers less degradation in performance as 
compared to the old guidance law. When “frequency” of tracking loss events is low (less than 
12%), the new guidance law is still able to provide better performance than the old guidance 
law As the “frequency” of tracking loss events increases further (between 12% to 25%), the 
performance of the new guidance law starts rapidly degrading, converging to that of the 
initial system; the target estimator is no longer able to provide a good prediction of the target 


velocity and heading to the guidance law. 
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I. INTRODUCTION 


A. BACKGROUND 


Network Centric Warfare (NCW) is the best term developed to date to describe 
the way the modern military forces will fight in the coming Information Age. It is defined 
as an information superiority-enabled concept of operations that generates increased 
combat power by networking sensors, decision makers, and shooters to achieve shared 
awareness, increased speed of command, higher tempo of operations, greater lethality, 
increased survivability, and a degree of self-synchronization. Essentially, NCW translates 
information superiority into combat power by effectively linking knowledgeable entitles 


in the battle-space [1]. 


The Unmanned Aerial Vehicle (UAV) plays an important role in NCW and is 
increasingly used by many military forces around the world to perform primarily 
Intelligence, Surveillance and Reconnaissance (ISR), communication relaying and small 
payload delivery missions in modern day’s battlefield. For instance, the U.S military had 


reported that an increased usage in UAVs was observed in the wars in Iraq and 


Afghanistan!, Faced with the ever growing demand to deliver real-time information to 
other entitles in the battle-space, the UAV operators will have to multi-task and work 


harder in order to effectively control the UAV and process key intelligence. 


The current process for visually tracking a target with a pan-tilt gimballed camera 
mounted on a UAV requires two operators. The first operator is responsible for 
controlling the platform (UAV) while the second operator controls the payload 
(orientation of the gimballed camera). In order to keep the camera aimed at the target, the 
two UAV operators have to coordinate closely and continuously communicate with each 
other. If the target makes an evasive manoeuvre and gets out of the gimbal operational 
limit or out of the camera resolution range, the payload operator will need the UAV pilot 


to manoeuvre the platform in order to reacquire the target again. This can take a 


! Armed Forces International, “US Military’s UAV Missions Increasing.” [Accessed November 09] 
Available: http://www.armedforces-int.com/news/us-militarys-uav-missions-increasing.html 
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significant amount of time even if both operators are very well trained. Obviously, a fully 
autonomous UAV equipped with the proper instrumentation and control software would 
help to alleviate the problem of human constraints. A Visual Based Target Tracking 
(VBTT) system that automatically couples the dual objective of manoeuvring the 
unmanned aerial platform and its sensor payload should significantly support both 


operators, enabling them to for mode challenging missions than ever before. 


B. OVERVIEW OF RESEARCH PROJECT 


This thesis is an ongoing effort within the Unmanned Systems Research Group in 
the Naval Postgraduate School (NPS) to develop a prototype VBTT system for a SUAV, 


as shown in Figure 1. 





Figure 1. NPS Small UAV (Sig Rascal) 


The VBTT system comprises the modified remotely controlled small aircraft 
equipped with an industrial autopilot and a miniature pan-tilt gimbaled camera using 
commercial off the shelf components and custom build control software. The system 
controls both the platform and the gimbaled camera with the objective to (i) keep the 
operator-selected target in the center of the video image, to (ii) coordinate guidance of the 
UAV around the target, and to (iii) provide a real time estimate of the target motion 
including its geodetic position, speed and heading. 

Three major components were developed and integrated onboard to create the 
VBTT system [9]. The first component of the system includes a VBTT capability that 


uses the video imagery provided by the gimbaled camera. Development of this 


component involves the design of a miniaturized gimbaled camera and a controller, and 


Z 


integration of the automated motion tracking software by PercepiVU, Inc [2]. The 
development of the adaptive controller for the gimbaled camera loop is presented in 
Section HI. The second component consists of a target motion estimator and the 


development for the estimator is also presented in Section III. 


The final component of the system includes the guidance law for the SUAV. The 
control algorithm is designed to navigate the SUAV around the target while keeping the 
target in the center of the camera frame. The range estimation error is at its minimum 


when the target is moving in parallel with the camera image plane [9]. 


C; OBJECTIVES AND SCOPE OF WORK 


This thesis extends previous works [2] — [5] by investigating the robustness of the 
newly developed control law in response to variation in target velocity and “frequency” 
of tracking loss events. The results obtained are to be based on the high fidelity 6DOF 
simulations implemented in SIMULINK and analyzed using the multi-criteria 
optimization technique introduced in previous work [10]. The results obtained are then 


compared against those that are obtained from the current control law. 
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HT. DEVELOPMENT OF CONTROL LAW 


A. COORDINATE SYSTEMS 


Multiple coordinate frames are often used to define the motions or behaviors of 
various objects in complex dynamic systems. The translational and rotational kinematics 
states (i.e. the positions, velocities and accelerations) of an object can be fully described 
in any frame as long as the transformation relationships between the coordinate frames 
are known. The following coordinate systems were used in the development of the 


control laws in this thesis [2] — [10]. 


1. Navigation Inertia Coordinate Frame (I — Frame) 


This local level frame assumed a flat earth model in the vicinity of the reference 
navigation point; the X, — Y, axes lie in a plane tangent to the reference point origin on 
the earth ellipsoid surface, and the Z, axis lie perpendicular to that ellipsoid surface. As 
illustrated in Figure 2, this is a North-East-Down (NED) coordinate system and is also 


known as the Local Tangent Plane (LTP). 








Figure 2. NED Coordinate System 


2: SUAV Body Coordinate Frame (B — Frame) 


A convenient coordinate system for developing the equations of motion of the 
SUAV is a right-hand orthogonal system with its origin centered at the aircraft’s center of 
gravity. Conventionally, the x-axis points forward along the longitudinal axis of the 
aircraft, the y-axis points outward towards the right wing, and the z-axis points 


downward from the origin (see Figure 3). 
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Figure 3. SUAV Body Coordinate Frame 


3. Gimbal Platform Coordinate Frame (G — Frame) 


The gimbal coordinate frame is a right-hand orthogonal coordinate system whose 
origin is at the location of the camera mount. The x-axis of the gimbal frame points 
forward along the longitudinal axis of the gimbal platform, the y-axis points outward 


towards the right-hand side, and the z-axis points downward from the origin. 


4. Image Plane Coordinate Frame (P — Frame) 


The image plane reference frame is the coordinate system used to describe the 
location of the target in the image plane. It is a two-dimensional coordinate system with 
the u-axis aligned with the y-axis of the camera coordinate frame, and the v-axis aligned 


with the negative z-axis of the camera coordinate frame. 


B. EULER ANGLES 


Euler angles are the classical means of representing rotations in three-dimensional 


Euclidean space. The triplet of Euler angles (¢,0,y ) relates two orthogonal coordinate 


systems having a common origin and the coordinate frames can be transformed from one 
to the other through a series of rotations defined by the Euler angles. Conventionally, 
when the Euler angles used to describe the orientation of the aircraft body in relation to 


the inertia coordinate frame, these Euler angles are known as roll, pitch and yaw [6] — [8]. 


Cc; RELATIONSHIPS BETWEEN COORDINATE SYSTEMS 


A coordinate transformation is a conversion from one coordinate system to 
another, to describe the same space. A rotation is a type of transformation from one 
system of coordinates to another such the distance between any two points remains 
invariant under the transformation. A rigid body in space can be represented by a [3 x 1] 
vector, and its orientation to its own current coordinate frame or a transformed coordinate 
frame can be uniquely described by a [3 x 3] rotation matrix at any instant in time [6] — 


[7]. 


1. Rotation Matrices 


The rotation matrices for a single two-dimensional rotation about each individual 
axis are given below. The angle of rotation is the Euler angle that corresponds to each 


individual axis. 


| cos(yw) sin(y) 0 
R.(y)=|-sin(y) cos(yw) 0 (1) 
0 0 1 


R,(@)=| 0 1 0 (2) 





1 0 0 
R,(¢)=|0 cos(¢)  sin(¢) (3) 
0 -sin(¢) cos(@) 


The complete rotation or transformation of the coordinate system is the sequential 
combination of the two dimensional rotations about each axis. The sequence, or order of 
the rotation, is necessary to properly define the orientation of the body and to preserve the 


orthogonality conditions (right-hand system or left-hand system) of the transformed axes. 


2. Coordinates Transformation 


The coordinate transformation, or rotation from the inertia frame to the camera 
frame, can be obtained via sequential coordinate transformations from one frame to the 


other in the correct logical order, as shown below: 

Cc CpGpB 

iR= GRgR_R (4) 
where ?R = coordinate rotation from inertia frame to body frame 


CR = coordinate rotation from body frame to gimbal frame 


¢R = coordinate rotation from gimbal frame to camera frame 


a. Inertial Frame to Body Frame Transformation 


The coordinate transformation from the inertia frame to the body frame is 


simply the product of the three individual rotation matrices: 
TR = Ry (‘Gy ) Ry ("95 ) Re (‘Ve ) (5) 


b. Body Frame to Gimbal Frame Transformation 


The coordinate transformation from the body frame to the gimbal frame 
only involves rotation through two angles because the gimbal platform is a two axis 
coordinate system. As there is no rotation along the x-axis (roll rotation), the gimbal roll 


angle is taken to be zero. 


pR=R,("O;)R, ("We ) (6) 


c. Gimbal Frame to Camera Frame Transformation 


The coordinate transformation between the gimbal frame and the camera 
frame allows for compensation of any misalignment angles that exist between the 
mounting of the camera platform with the gimbal platform. In all likelihood, some or all 


of the rotation angles will be zero because the axes will be directly aligned. 


cR=R,(“b.) Ry (%O.)R, (“Ve) (7) 


d. Camera Frame to Image Plane Frame Transformation 


The coordinate transformation between the camera frame and the image 
plane frame is not a rotational but a positional transformation. As illustrated by Figure 4, 
the position of an object in the image plane frame from a position in the camera frame is 


given as below: 


gee tee 
Aiea : 





: cy 


v 


°Z 


Figure 4. Image Plane Reference Frame 


It is of interest to note that, unlike the previous rotational transformations, 
the camera to image plane transformation is irreversible. This is due to the transformation 


of a three-dimensional coordinate system to a two-dimensional coordinate system. 


3. Angular Velocities Transformation 


a. Body Frame Angular Velocities with Respect to Inertial Frame 


The angular velocity vector, @, in the body fixed coordinate system of the 
SUAV, has components [p, q, r] in the x, y and direction respectively. The resulting 


relationships with the Euler angle rates [dy ; 6,.Wy | for which are stated as follows: 








0 0 0; 
"Oy = Ry ("bs ) Ry (185) Ry (Vs) 0 +Ry (“G5 ) Ry ('8,) 0; +Ry ('4,) 0 
Vs 0 0 
, Ps WV, Be 0, + $, b, —Ws sin’ 0; 
"Op, =| @, Pp w, +0,+¢, |=|w, cos! 0, sin’ ¢, +4, cos’ g, (9) 
o,| |o.| |w.+0.+¢.| |w,cos! 6, sin’ ¢, —6, cos! d, 


Expressing [¢,,0,,y,] in terms of [ p,,4,.%,] below, we observe the 


singularity problem in Equation (10) when ‘0, =+90°: 








a: tt BAW | 
' cox) sin( bs) +1, cos( b,)| 
Os = qp cos('¢,)—r, sin(‘d, ) (10) 
?s Pp +tan(‘0,)] 4. sin(', ) +7, cos(“¢,) | 
b. 


Gimbal Frame Angular Velocities with Respect to Inertial Frame 


The angular velocities of the gimbal frame with respect to the inertia 
frame are as shown below. Equation (10) relates the angular velocity expressed in the 


gimbal platform frame while Equation (11) describes the transformation of the same 
angular rate in the inertia frame. 
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Tp Vo 0 
Ds 0 0 
“Gq = 5R| ag |+ §R| 0 |+R,('0,}| 4 (11) 
'p Wo 0 
Pc 
"Ogi = GR Oe, 7 GR IG (12) 
le 
C; Camera Frame Angular Velocities with Respect to Inertia Frame 


If the camera frame is perfectly aligned with the gimbal frame, there will 
not be any rotation between the two frames. Hence, the angular rates between the two 


frames will be the same. The relationships are expressed as below: 


Cc _ CpG 
Oc = ¢R OG, 


Since ¢R=T, 


Pg 

“Oe, = “Wg, =| Ie (13) 
'G 

‘Oe = ' Og (14) 


D. KINEMATIC EQUATIONS OF SUAV-TARGET MOTION 


A simplified two dimensional kinematics model is presented in Figure 7. The 
figure depicts the kinematic relationships between the angles used to characterize the 
relative motion of the SUAV-Target system. In order to simplify the formulation of the 
target tracking and UAV control tasks to a 2D plane, it is assume that the autopilot is 
capable of maintaining level flight of the UAV and the onboard two-axis gimbal is 


inertially stabilized [3], [5], [9], [10]. 
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North X 





Target 
7 = Navigation Error Y =UAV Heading in Inertia Frame 
€ =Camera LOS Pan Error y, = Target Heading in Inertia Frame 
A =LOS Angle in Inertia Frame y, = Camera Angle in UAV Body Frame 
A, =LOS Vector v.._ = SUAV Ground Speed in Inertia Frame 
8 & 
AZ. =Normal to LOS Vector V. = Target Ground Speed in Inertia Speed 
Pp 
Figure 5. Kinematics of SUAV — Target Motion 


The following set of basic kinematical relations is derived directly from the 


kinematics of Figure 5. First, it is observed that: 


TW 
n=w-(4-4] (15) 


Next, projecting the SUAV and target speed vectors onto the LOS results in the 


time derivative of the horizontal range to the target: 
p,=-V, sinn +V, sin(y, -(w-n)) (16) 


Similarly, projecting the same vectors onto the line orthogonal to the LOS 


produces the rotation speed of the LOS: 


jas cos _V, cos(y, -(y—1)) (17) 
p P 





Finally, an expression for the tracking error € is given by: 
12 


é=A-y-y, (18) 


Substituting Equation 17 into time derivatives of Equations 15 and 18 produces 


the following set of equations describing the kinematics of the tracking problem: 


V, cos —V, cos(y, —(w -7)) 








n= +y (19a) 
p 
p.=-V, sing +V, sin(y, -(y-n)) (19b) 
V, cos7 —V, costy, —(w— 
4, Vec0s7-V, cosy, -(v Ds . aes 
fe) 
E. CONTROL LAW DESIGN 
1. Initial Control Law Designs 


The initial control law design of the VBTT system has the following form [2]: 
yw = sign( Bias —k,n) (20a) 
WY, =k,€ (20b) 


The advantage of this control law is that it is simple to implement and the 
algorithm relies exclusively on the information gathered from the image processing 
software. However, two main limitations are observed for this control law. Firstly, as a 
fixed bias value is applied to turn the SUAV in Equation (20a), this results in a slow 
converging speed to any other desired range commanded, except to the desired range that 
corresponds to the arbitrary turning bias value. Secondly, as the camera LOS turn rate is 
independent of the SUAV turn rate, this results in poor control of the camera LOS and a 
large kz value is needed to keep the camera LOS closely aligned to the SUAV-target 
LOS. 


To overcome these limitations, the control law is then adjusted to the following 


form [3]: 
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. V. 
w=—cosn—kn (21a) 


Pa 
y, =kint+ké (21b) 


With the addition of a k,7 term to Equation (20b), the camera control has become 


more efficient as the camera turn rate is now coupled to the SUAV turn rate. The turning 
bias in Equation (20a) is replaced with the dynamically adjusted quantity in Equation 
(21a), which varies with the SUAV ground speed and the desired range to target. For a 
stationary target, if the SUAV starts tracking a target at a distance smaller than the 
commanded range, it will spiral outwards to the desired range. Conversely, if the SUAV 
starts tracking a target at a distance larger than the commanded range, it will spiral 
inwards to the desired range. The navigation angle error 7 will approach to zero when 


the SUAV establishes a circular orbit about a stationary target at the desired range. 


The feedback system consisting of Equations (19) and (21) is given by: 


9 =—V,p,cosn—k,n+V, cos(—y) P (22a) 
. —2 . . —2 
p.=pV,sinn—V, sin(7—y)p (22b) 
é=V,p, cosy —k,é—V, cos(7-y) p (22c) 
1 1 2 \ 1 
whete P25 PP He 
P Pa Pp Pa 


This control law is currently being used in the VBTT system for the NPS SUAV. For 
convenience of notation, this control law will be referred to as the “current control law”. 
Notice that the current control law still relies exclusively on the information gathered 
from the image processing software. 

2. New Control Law Design 

From Equation (22b), it is observed that when the navigation error 7 1s driven to 


zero, Pp, =V, sin(y) p +0 (unless the target is stationary). Hence, the objective of the 
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current control law to regulate 77 to zero will not result in a constant p . This results in the 
need to reformulate the control objective and to come out with a new control law design 
[5]. 

According to Equations (19a) and (19b), the kinematics for 7 and p= is 


independent of the camera LOS pan error. Thus, in the design of the new control law, it 


is assumed that ¢€ is in the visible angle range to provide the necessary visual feedback. 


North = 
a 





Figure 6. Decomposition of SUAV velocity vector V, 


Consider the decomposition of the SUAV ground vector V, as shown in Figure 6 
[4], 

V,=V,+ (23) 
where V. is the target velocity vector, and V. = V, —V, is the remaining velocity vector. 
The following relationships are then derived: 


V, cos7 =V, cos7, +V, cos Ly. -(y-n)] (24a) 
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V, sin =V, sin, + V, sin Ly, -(y-n)| (24b) 
where 77. is the angle between V. and Ais 


Substituting Equations (24a) and (24b) into Equations (19a) and (19b), the system 


kinematics can be written as: 
: V : 
1 =——~cosn, +W (25a) 
p 


p, =—V,sinn, (25b) 
Since 7, =0 leads to p, =0, this suggests that 77, =0 can be the control objective. 


Assuming that the target velocity V, is constant with constant heading, this 


composition can be interpreted by considering the target coordinate frame (T-frame), 


whose origin is fixed on the target. In this frame, the target is static and the SUAV is 
flying with time-varying velocity V, (1) with the angle 77, (1) from A, . The dynamics for 


7,(t) can be written as: 


#,(t)= aaa cosn, (t)+u, (t) (26) 


where u, (t) is the turn rate of the “virtual SUAV” with velocity V, (t) : 





To find the relationship between u, (t) and y(t) , assume that the target is moving with 


constant velocity and heading, and take derivative of Equation (26). Then, from classical 
mechanics: 
V,ii, +i, xV, =i, xV, (27) 


where wu, denotes the three dimensional angular velocity vector for the SUAV, 7, is the 


normalized vector in the direction of V,. Since i, xV.is perpendicular to 7i,, taking the 


inner product of both sides of Equation (27) with n, gives: 
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V =(i xV ).ai (28) 


((i, xV, ).H, )ii, +i, xV, =i, x (29) 


Since the two terms on the left hand side of Equation (29) are perpendicular to each other, this 


implies that: 

















u, = : (30) 
Thus, the kinematics of the system in the T-frame is given by: 
, __Y(?) } 
1, =-—~c08n, (t)+mi(t)w(t (31a) 
eayconm ttm DH) 
p. =-V,(t)sin7, (t) (31b) 





where m/(t) = Vi= \V, -V. 





The new control objective is to regulate 77, (t) to 0 and thus drive p( t) to ~, (which is 
the desired range to target). To achieve this, the control law for implementation on the SUAV 


autopilot controller is as shown below: 


1 V, (t) 


goon ttt ooan. (9 39 





Thus, the feedback system consisting of Equations (19) and Equation (32) is given by: 


i()=-bn (vo % 


Pi Plt) 





Jos 77, (t) (33a) 


p(t) =—V, (t)sin7, (t) (33b) 
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F. SUMMARY OF THE CONTROL LAW DESIGNS 


Based on the information gathered from previous works, a summary of the pros 


and cons of each control law design is presented in Table 1. 





Current Control Law New Control Law 





Pros - Simple to implement. - Perfect range holding capability. 


- Relies exclusively on passive 
information gathered from the image 
processing software. 








Cons - Range holding capability depends | - Requires information on target 
on the target motion. velocity and heading. 











Table 1. | Comparison of Control Law Designs 


G. TRACKING LOSS EVENTS 


Due to space and computational power constraint, the image based tracking 
software cannot be placed onboard the SUAV and the visual part of the control loop has 
to be closed on the ground. Hence, a critical issue that must be addressed by the VBTT 
algorithm is its performance in the presence of tracking loss events defined here as any 
event that causes the image processing software to lose tracking of the target. From the 
experience gathered from previous flight tests, this event occurs primarily due to the 
dynamic change of lighting conditions and radio frequency interference in video and 


control links. The tracking loss can be defined as a binary signal [2]: 


0 out-of frame event at time t, 
s(t)= (34) 


1 camera tracks target at time t. 
For a given binary signal s(t) wiet 7, (z,t) denote the length of time in the interval [z.¢] 


when s (t) = 0. Then, formally, 


T, (t,t) =[(t-s(0)jt0 (35) 


The image processing software will experience a brief target loss event if: 
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T,(z.t)<sQt+a(t-r), 12720, (36) 


for some 7, >0 and @e[0,1]. The scalar 7, is called the instability bound and @ is 
called the asymptotic instability ratio. a@ will provide am asymptotic upper bound on the 
ratio T,(z,t)/(t-7), as (t-7) > 0, 


From previous work [2], [5], both control laws are expected to suffer predictable 


degradation in performance when tracking loss events (TLE) occur. 
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Hl. IMPLEMENTATION OF CONTROL LAW 


A. FAST ESTIMATION OF TARGET MOTION 

As seen from Equation (32), the new control law requires information on the 
target velocity and heading in order for it to generate the appropriate control input w for 
the autopilot. A fast estimator can be applied to generate an estimation of the target 
velocity and heading [11]. The target motion estimation consists of two steps. Firstly, the 
target position is calculated based on the available measurements. Thereafter, the target 
velocity and heading is estimated using the fast estimator. 

iF Calculation of Target Position 

The relative position between the target and the SUAV in the I-frame and C- 
frame are denoted by p= [ Pus DysP: i and p,=[x,,y,.z,] respectively. Thus, the 


following relationship can be derived: 


x. P, P, 
y,]= 5R7R| p, |= sRIR| Py (37) 
Z P. h 


where £R and ?R can be obtained using the Euler angles of the SUAV and the pan/tilt 


angles of the camera provided the onboard IMU. Assuming the camera follows the pin- 


hole model, 


y./x.|_|u/F 
Babe 09 


where F is the focal length of the camera and (u,v) is the position of the target image in 


the P-frame. Thus, Equation (37) can be rewritten as: 


1 1 p/%, 
y./x, |=|u/F |= RR] p./x. (39a) 
ZX v/F h/x., 
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P,/*, 1 
p.[x. |=(SRER) | u[F (39b) 
h/x v/F 


c 


Hence, ( Pes P,) can be calculated since all the terms of the right hand side of Equation 


(39) are known. The target in the I-frame can be obtained using the SUAV position in the 
I-frame given by the onboard GPS. 


Py 
Prarget = Pray a p= Pray + Py (40) 
h 


Ze Estimation of Target Velocity and Heading 


Let x(t) = [ p,(t), Py (x) be the horizontal component of p(t) that has being 


calculated in the previous section. From Figure 4, x(t) satisfies the following 


kinematics: 


orfpihvoleetoleg) 


cosy (t) cosy, (t) 


Define the second term of Equation (41) as: 


ofe)=W(0] et], el0)=oy 


cosy, (t) 


The estimate of the target velocity V(r) and heading w,(r) can be obtained 


through the following steps: 


a. State Predictor 
andes siny(t)| . Like. 
&(t)=A,,x(t)-V, (| rt fe. sO) =a, (42) 
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where X(t) =X(t)—x(t) and A, is a known Hurwitz matrix chosen to satisfy the 


performance requirements. 
b. Adaptive Law 
o(t)=L, Proj(@(t),—Px(t)), @(0)=a (43) 
where I’, >0 determines the adaptation rate, chosen sufficiently large to ensure fast 


convergence, P is the solution of the algebraic Lyapunov equation A,”P+PA, =—Q for 


some choice of matrix —Q <0 and Proj (+) is the projective operator which keeps the 


parameter within the pre-defined bound. 


c. Low-Pass Filter 
a,(s)=C(s)a(s), @,(0)=a, (44a) 
@,(s)=C(s)a(s), @,(0)=a (44b) 


where C(s) is a diagonal matrix with its i" diagonal element C.(s) being a strictl 
8 x 


proper stable transfer function with low-pass gain C, (0) =1 for i=1,2. 


d. Extraction of V,(t) and W,(t) from @, (t) 


The target velocity and heading can then obtained from the following 


relationships: 


V, (t) = Ja; (t) +0, (t) (45a) 





y(t) = tan" | a(t) (45b) 


More of theoretical details on the development of performance bounds can 


be found in [5] and [11]. 
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B. 


CONTROL SYSTEM ARCHITECTURE 


The control architecture that implements the control law is presented in Figure 7 


[2]. It consists of an autopilot and a gimbal driven by the control inputs yw and y,. The 


onboard CCD camera provides real-time imagery to the image tracking software. When 


target lock is engaged, the image 


tracking software will compute the camera LOS pan 


error €. The onboard GPS and INS will in turn provide the solution for the navigation 




















error 7). 
VY ; . — yr Y- ' ae . 
ey Compute -—>} VB | NPS Autopilot ——* UAV | 
es 7 \ j P 
& re “o , : } | 
W, “1__* aoe Control ys Gimbal —+, CCD Camera | 
Tar get position im the | Image Anal | 
comera frame Tracking 
Figure 7. Control System Architecture 
C. SIMULINK MODEL SCHEMATIC 


The VBTT SIMULINK model schematic for the current control law in Equation 


(21a) is presented in Figure 8. 


















SUAV Commanded ; SUAV Flight 
Yaw Rate Autopilot / 6DOF Dynamics 
SUAV Model 
Gimbaled Camera [* 
Camera Pan/Tilt Model - 
Angles & Errors | Target 
=! Target | Model 
SUAV CurGuid Dynamics 








Controller Model | 





Figure 8. 





Desired Range 


VBTT SIMULINK Model Schematic for Current Control Law 
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The current control law for the SUAV yaw rate command wy is being 


implemented in the “CurGuid Controller” block (see Figure 9). 


Remd, m 


Gviner. mis 









[Vo Ve 0] -—_—_——————, 
Turn Direction 

Eulers 
sign(V/Roos(eta)-*1*eta) Gimbal angles 


limited signal Gimbel angles, rad 

















t_cmd, rad/s ae \*—_@ 
a Gimbal errors, rad 
Signal Limiter 
Figure 9. “CurGuid Controller Block” for Implementation of Current Control Law 


The VBTT SIMULINK model schematic for the new control law in Equation (32) 
is presented in Figure 10. Comparing Figure 8 and 10, the main difference between the 
two schematics is that the VBTT SIMULINK model schematic for the current control 
law does not include the “Target Estimator” block, since the current control law relies 


exclusively on the information gathered from the image processing software. 


SUAV Commanded SUAV Flight 


Autopilot / 6DOF 
SUAV Model 


Yaw Rate Dynamics 
















Gimbaled Camera 
Camera Pan/Tilt Model < 


Angles, Target Image Target 
Target Model 
Target [ Dynamics 
Estimator k 




















| Estimated Target 
| Position & Velocity 
SUAV CurGuid 
Controller Model Picasa 
Figure 10. VBTT SIMULINK Model Schematic for New Control Law 
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The new control law for the SUAV yaw rate command y is being implemented 


in the “CurGuid Controller” block (see Figure 11). 
















































































turn_dir Vtarget_est 
| = Gt Vinert, m/s 

remd Jim{ViRoos(ets_r}-k1"eta_r) ft z ; le = 

ae 
@pe— ————rc_cma, rad/s Prop gain 
r_cmd, rad/s ons | }¢—GD 
V_inertial + etat 
Turn Limiter 
Figure 11. “CurGuid Controller Block” for Implementation of New Control Law 


D. L; ADAPTIVE CONTROLLER FOR GIMBALED CAMERA LOOP 


To guarantee the transient performance of the gimbaled pan turning and its 
robustness to time-delay due to image processing and varying communication conditions, 


a newly developed L; adaptive controller is applied to the gimbaled pan control loop 
[12], [11]. For simplicity of notation, let u,,(t)=—y,,(t). Therefore, Equation (19) can be 


rewritten as: 
é(t)=a,e(t)+u, (t)+ae(t)+o(t) (46) 


where a,,<0, @=—a,,, u,(t)=—w,(t), 





se V, cosy (t)—V, solr -(v(t) —n(t)) | W(t) 


The L; adaptive controller consists of the state predictor, the adaptive law and the control 


law given in the following steps: 


1. State Predictor 


&(t)=a,€2(t)+u,(t)+a(t)e(t)+E(t), — &(0) =, (47) 


25 Adaptive Law 


The parameter estimations @(t) and G(t) are governed by the following 


adaptive laws: 
@(t)= Proj(@(t),-é(r)e(t)), &(0) =a, (48a) 
6(t)=I Proj(G(t),-&(r)), &(0)=6, (48b) 

where I, >0 determines the adaptation rate and &(t)=é(t)—e(t). The projection 


operators ensure that the parameters are kept within the predefined bounds. 


J Control Law 

The control signal u, (1) is generated through the feedback of the following 
systems: 

x(s)=D(s)r(s) (49a) 

u,(s)=-ky(s) (49) 
where k>0 and D(s) is any transfer function which leads to a strictly proper stable 


transfer function: 


kD(s) 


(s)= ig (50) 


More of theoretical details on the development of performance bounds can 


be found in [5] and [12]. 
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Hil. SIMULATION RESULTS 


A. SELECTION OF MEASURE OF PERFORMANCE 

The performance of the new control law is examined for variation in feedback 
control parameter k,, the relative velocity ratio of the target and SUAV V, /V, and the 
“frequency” of tracking loss events. The results obtained are then compared to those that 


were obtained in previous work for the current control law [9] — [10]. 


To evaluate the performance of the new control law, three measures of 
performance (MOP), M:, M2 and M3 are being devised. These three MOP are assumed to 
be independent of each other. The physical meaning and definition of each MOP are as 


follows: 


The first MOP, M, is defined as inverse of the ratio of the captured range over the 
convergence time. The convergence time is the time taken for the SUAV to converge to 
its first zero crossing of ~, , while the captured range is the radial range that is covered by 
the SUAV during the convergence period. A lower value for M; is desired, as it 


represents a faster range capturing capability. 


The second MOP, Mz is devised to measure the time-averaged deviation from the 
commanded range. The deviation from the commanded range is only measured after the 
SUAV’s first closest approach. A lower value for Mo is desired, as it represents better 
range holding capability of the SUAV. 

The final MOP, Mz is devised to measure the time-averaged navigation error. The 


navigation error 77, is the angle between the virtual UAV’s ground velocity vector (V.) 
and the normal to LOS vector (A, ) and it is only measured after the SUAV’s first closest 


approach. As seen from Equation (33b), regulating 77, to zero will in turn drive the range 


to target to the desired range. Hence, a lower value for M3 is desired, as it indicates better 


range holding capability of the SUAV. 
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B. SENSITIVITY ANALYSIS OF MOP TO VARIATIONS IN &, 


The sensitivity analysis of the new control law to variations of feedback control 
parameter k, is examined in a scenario where the target is moving with a constant 
heading and the commanded range is 300m. This scenario is chosen as a baseline model 
for further comparison with other target motion scenarios. The initial conditions are: (1) 
SUAV velocity = 25 m/s; (2) Target velocity = 8 m/s; (3) Initial position of the SUAV is 
at [-1000, 0, 500] and (4) Initial position of the target is at [0, 0, 0]. Thus, the initial 
horizontal ground range from the SUV to target is 700m. 





Performance of M,,M,,M, and M, with Variations to k, 














M,,M,,M 


Figure 12. Variation of “! 3 and Me versus k, 
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The following observations can be made from the plot as shown in Figure 12: 


(a) It is observed that M; increases with increasing k,. This in turn means that 
the convergence speed is decreasing with increasing k,. A higher value of k, causes the 


SUAV to incur a higher overshoot. As a result, the SUAV will take a longer time to 
converge to the desired range to target. It is also observed M3 decreases with increasing 


k,. Mb also decreases with increasing k, till k, reaches a value of 0.5. Thereafter, Mo 


is 
starts to increase with increasing k, . 


(b) As M;, M2 and M3 varies differently with increasing k,, there is an 


obvious need to introduced a new MOP for the purpose of finding an optimal trade off 
among the criteria [10]. Therefore, Mo is introduced as the square root of the sum of 


squares of the three independent parameters: 
M,=\M,+M,+M, (48) 
The parameters are properly scaled before the convolution; the discussion is not a subject 


of this thesis work. The choice of the MOP is motivated by the fact that k, can be 


represented by a point in a three dimensional (3-D) space defined by the three MOP {M,, 
M2, M3}. As the control objective is the minimize all three MOP, this corresponds to a 


search for a value of k, such that the distance from the origin of this 3-D space is 


minimized as graphically shown in Figure 13. 
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— M, = Minimum Distance 


M, 


Figure 13. Motivation for Multi-Criteria Optimization 


(c) From Figure 12, it is also observed that Mo attains a minimum value when 


k, is at a value of 0.4. Thus, k, is set to 0.4 for the remaining experiments as it provides 


us with the optimal performance for the new control law. 


32 


Figure 14 presents the results obtained for the new control law when {, is set to 


0.4. 








14(a) SUAV & Target Trajectory 
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14(b) Range Convergence, Range Holding & Navigation Angle Error Performance 
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14(c) SUAV Pan & Tilt Errors 
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14(d) Target Estimator Performance 
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Figure 14. 
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C. SENSITIVITY ANALYSIS OF MOP TO VARIATIONS IN V, / V, 


The sensitivity analysis of the new control law to variations in V, /V. is examined 
in a scenario where the target is moving with a constant heading and the commanded 
range is 300m. The initial conditions are: (1) SUAV velocity = 25 m/s; (2) Initial position 
of the SUAV is at [-1000, 0, 500]; (3) Initial position of the target is at [0, 0, 0] and (4) 
k, =0.4. Thus, the initial horizontal ground range from the SUV to target is 700m. 


Mo, which is defined in the previous experiment, will be utilized to access the 


sensitivity performance of the new control law to variations in V, i a 





Performance of M,,M,,M, and M, with Variations to V, /V, 
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Figure 15. Variation of ~ "2" 3 and Ms versus Speed Ratio V, /V, 


The following observations can be made from the plot as shown in Figure 15: 
(a) It is observed that M; increases with increasing V,/V, . This in turn means 


that the convergence speed is decreasing with increasing V, /V, . As the target velocity 
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increases, the SUAV takes a longer time to converge to the desired range to target. It is 


also observed that both Mz and M3 increases with increasing V, /V, . In particular, Mo 
increases substantially when V,/V, is at a value of 0.56. 

(b) From Figure 15, it is also observed that Mo increases with increasing 
Vv /V, . Similar to M2, Mo increases substantially when V, ING is at a value of 0.56. This 


suggests that the performance of the new control law degrades drastically when the target 


velocity is more than half of the SUAV velocity. 


Figure 16 to 20 presents the detailed results obtained for the new control law 


when V, /V, is varied from 6/25 to 14/25. 
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Case 1: V,/V, = 6/25 
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Case 2: V,/V, =8/25 
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17(b) Range Convergence, Range Holding & Navigation Angle Error Performance 
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17(c) SUAV Pan & Tilt Errors 
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Case 3: V,/V, = 10/25 
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18(b) Range Convergence, Range Holding & Navigation Angle Error Performance 
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Figure 18. 
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Case 4: V,/V, =12/25 
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Figure 19. 
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Case 5: V,/V, =14/25 
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20(c) SUAV Pan & Tilt Errors 
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D. COMPARISON OF CONTROL LAW’S PERFORMANCE WITH 

REGARDS TO VARIATIONS IN V, /V, 

Figure 21 gives a comparison of both control laws with regards to variations in 
V 1¥. . For both control laws, it is observed that Mo increases with increasing V, /V, . 
Thus, both control laws deteriorates in performance when the target velocity is increased. 
However, the new control law suffers less degradation in performance as compared to the 
current control law. By regulating 77,(t) instead of 7(t) to 0, the new control law 
performs better than the current control law in driving the range to target to the 


commanded range. 





Comparison of Control Laws’ Performance With Regards to Variations in V, /V, 
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Figure 21. Plot of Mo vs V,/V, for Current and New Control Law 
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E. SENSITIVITY ANALYSIS OF MOP TO “FREQUENCY OF TLE 

The sensitivity analysis of the new control law to “frequency” of TLE is 
examined in a scenario where the target is moving with a constant heading and the 
commanded range is 300m. The initial conditions are: (1) SUAV velocity = 25 m/s; (2) 
Target velocity = 6 m/s; (3) Initial position of the SUAV is at [-1000, 0, 500]; (4) Initial 
position of the target is at [0, 0, 0] and (5) k, =0.4. Thus, the initial horizontal ground 


range from the SUV to target is 700m. 





Performance of M,,M,,M, and M, with Variations to “Frequency” of TLE 
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Figure 22. Variation of ~ !’"~2’""3 and M, versus “Frequency” of TLE 
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The following observations can be made from the plot as shown in Figure 22: 


(a) It is observed that M; decreases with increasing “frequency” of TLE till 
the “frequency” reaches a value of 10%. Thereafter, M; starts to increase with increasing 
“frequency” of TLE. It is also observed that M3; increases with increasing “frequency” of 
TLE. M2 also increases with increasing “frequency” of TLE till the “frequency” reaches a 


value of 15%. Thereafter, M2 starts to decrease with increasing “frequency” of TLE. 


(b) From Figure 22, it is observed that Mo increases with increasing 
“frequency” of TLE till the “frequency” reaches a value of 15%. Thereafter, the value of 
M; starts to converge to about 1.2 even though the “frequency” of TLE is increasing. 
When TLE occurs, the camera will not be able to provide an updated target picture to the 
target estimator. Without the updated target picture, the target estimator will not be able 
to give a good prediction of the target velocity and heading. As such, the new control law 


suffers a predictable degradation in performance when TLE occurs. 


Figure 23 to 27 presents the detailed results obtained for the new control law 


when “frequency” of TLE is varied from 5% to 25%. 
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5% 


Case 1: “Frequency” of TLE 
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23(c) SUAV Pan & Tilt Errors 
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Case 2: “Frequency” of TLE = 10% 
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Case 3: “Frequency” of TLE = 15% 
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= 20% 


Case 4: “Frequency” of TLE 
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26(c) SUAV Pan & Tilt Errors 
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= 25% 


Case 5: “Frequency” of TLE 
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27(c) SUAV Pan & Tilt Errors 
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F. COMPARISON OF CONTROL LAW’S PERFORMANCE WITH 
REGARDS TO VARIATIONS IN “FREQUENCY” OF TLE 


Figure 28 provides a comparison of both control laws with regards to variations in 
“frequency” of TLE. For both control laws, it is observed that Mo increases with 
increasing “frequency” of TLE. The new control law demonstrates better performance 
than the current control law when “frequency” of tracking loss events is low (less than 
12%). However, as “frequency” of tracking loss events increases (between 12% to 25%), 
the performance of the new control law degrades more than that of the current control 
law, as the target estimator is no longer able to provide a good prediction of the target 
velocity and heading to the control law. Beyond a “frequency” of more than 25%, the 
value of Mo appears to converge for both control laws. This suggests the existence of a 
lower bound in performance for both control laws with regards to variations in 


“frequency” of TLE. 





Comparison of Control Laws’ Performance With Regards to Variations in 
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Figure 28. Plot of Mo vs. “Frequency” of TLE for Current and New Control Law 
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IV. CONCLUSION AND RECOMMENDATIONS 


A. CONCLUSION 
To improve the range holding capability and therefore to drive , to zero, a new 
control objective is formulated by resolving V, and 7 to the T-frame, whose origin is 


fixed on the target. As a result, the new control law provides better range holding 
capability as compared to the previously developed control laws. However, the new 
control law requires information on target velocity and heading information in order to 
perform coordinated SUAV guidance and vision based tracking. This additional 


information is obtained from the newly developed target estimator. 


The results obtained from the utilization of the new control law in high fidelity 
SIMULINK simulation environment are encouraging and comparable to theoretical 
predictions. The results show that both control laws suffer predictable degradation in 
performance when subject to the external disturbances and tracking loss events. 
However, in the absence of tracking loss events, the new control law suffers less 
degradation in performance as compared to the current control law. When “frequency” of 
tracking loss events is low (less than 12%), the new control law is still able to provide 
better performance than the current control law As the “frequency” of tracking loss 
events increases further (between 12% to 25%), the performance of the new control law 
starts rapidly degrading converging to that of the initial system; as the target estimator is 
no longer able to provide a good prediction of the target velocity and heading to the 


control law. 


B. RECOMMENDATIONS 


After testing the robustness of the control laws to external disturbances in high 
fidelity simulation environment, the next logical goal will be to implement the control 
laws in a hardware-in-the-loop (HIL) simulation before the actual flight test. Although 
HIL simulation cannot replace actual flight testing, it can help to reduce the likelihood of 


failure by detecting bugs and deficiencies before risking the hardware in actual flight test. 
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Moreover, the HIL simulator provides an ideal training tool that can be used in the lab. 
The HIL simulator had being setup in previous work and the details on the HIL setup can 


be found in Reference 9 and 10. 
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